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i This outline is intended for use aV^ checklist for 
evaluating research proposals and reports. Criteria ai^ listed for 
evaluating each of the following areas: research problefi3.*design and 
procedures, analysis and conclusions, and personnel and fabiJ^ities. 
Additional criteria are given for evaluating empirical experimental 
studies, clinical observational studies, clinical teaching 
experiments, and organizational studies. Nine reasons for proposal 
rejection are listed. ^DT) 
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responsible for the quality of the original document. Reproductions 
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criteria can be used as a checklist for evaluating: research pro- 
Lipbsals aiid reports. It was ^developedx by the RaseUurch; Advisory Cona^ittfee }ixi^j\y^ 
■ respbns^^^^^^ specific charge to ; that- committee, ' Ter^ 

^/ yersi6n»^^^ ^re used as sources f or tihet^ £^ (tee o^ 

: postals vera^^^^^ by the U.S. Off ice of Education. ; Nine of thM 

are listed at the end of the criteria, ' ' 

:'' 1.^ . General Criteria ■tr;. 
■ ■ a; ""'The 'Problem . ^ .. - 



The problem is clearly stated, and the rationale is iogicaj 




i. 



in- . 



1. _ 

■ • ■ . V 

a. Th«. purpose i? concifiiely stated. 

b. Objectives are specified;. 

c. . Procedures are specified. \^ 

d. Variables are identified, and their relationship to theory 
or observation is explained. \(If the variables m new, 
then evidence from a pilot study is presented.) 

e. Research liypo theses are concise. 

f. Research hypotheses are logically developed from some theory 
or related problem, and they are clearly plausible. 

2. The problem is significant. 



a. 
b. 

c. 
d. 



Its relationship' to previous research has been well established. 
The hypothesized research findings should be generalizable be- 
yond the sample. : 

The study will make a contribution to the advancement of knowledge. 
The results will contribute to the solution of sOTie practical ; 
or theoretical problem. 



B. Design and Procedures 

1. The design of the study is appropriate to the solution of the 
problem. ' / 

a. The research design is fully described. , .. 

b. Assxmptions are clearly stated. / 

c. Delimitations are noted. • ^ 

d. The population and sample are described (geographical limits, 
-time period covered, sociological description, sampling units). 

' ^ e. The^ sampling method, is . appropriate and practical. 



£• Controls for sources, of error are described iand are appropriate 
. .(e«g«, sampling error, nonresponse, interviewer bias,' response 
i/error, response set, experimenter bias, teacher effect i control 
of variables, extraneous factors); 

1. The relationship of the procedures to the implementation of the 
design is appropriate^ ^ 

I a« The data-gathering methods are clearly described and meet^^e. 
/ requirements of thg problem^ 

/ bj The obtained sammj^ is of a sufficient size and is rep'resenta 
/ ' tive of the defmed population. ^/ 
/ c. The measuring imstruments are appropriate. / . 
/ d. The validity anA reliability of the evidence are established, 
or a procedure fa^=e^taljlishing the validity/and reliability 
of the evidence is' described. / 

. ' " ■ ' ■ / ' / . ■ 

Analysis and Conclusions (for research reports) 

' . • . ■ ' / • . 

1. The analysis of the data is appropriate.' 

a. The results of the analysis are clearly presented. 

b. The analysis methods are valid, approprifl(te, and 'properly 

applied^ ' - ' i ' / - 

c. The assumptions beh/ind the statistical tests are stated, and \ 
the relationship of the test to the diesign is appropriate. ■ 

2. ;The conclusions are reasonable. _ !■ 
/a. The conclusions are clearly state<i. 

I b. The conclusions are substantiated by the evidence presented. 

c. Interpretations and implications are impartial and scientific. 

d. A comprehensive discussion of the qualifications is given 
(methodological problems and errors,, alternative explanations, 
other limitations) . 

|3. The research is adequately repor/ted. 

a. The report is logically organized and cleanly written. 

b. Grammar and mechanics are adequate. 

; ^Personnel and facilities (for funding research proposals) 

\ \ 



1. The qualifications of the investigator tp conduct this study are 
adequate. ^ 'j 

a. Competence in the techniques involved is demonstrated. 

b. The investigator has^ adequate experience and timing for 
this research. ' 



c. The investigator is familiar with the pertinent literature, 

d. Adequate time commitments are indicated. 

2. The facilities for this study are adequate. 

' a. Requirements for equipment or personnel are realistic, 
b. The instructional setting is favorable (if applicable) . 

3. The relationship between the costs- of the study and the proposed 
activities is appropriate. 

a. Estimates' of anticipated costs are reasonable. 

b. Th^ number of p.er^ofin'er assigned to the project is reasonable. 

c. The relationship between the probable outcome in terms of its 
\ ' impac^t and the^ in\restment required is favorable. 



• / 



II. Additional Criteria ^lor Specific Categories of Studies s/ 

A. Empirical- -Experimental Studies 

1. The operationalization of the variables is appropriate. 

2. The instrumentation used to measuriB the variables is fully de^ 
scribed arid is appropriate. 

3. Treatments are fully docuniented and are replicable. 

,f . ■ ■ * * ■ * ,'. 

B. .Clinical--Observational Studies 

1. The phenomena under investigation are clearly identified. 

2. Interviews and observation guidelines are related to the key 
elements of the study • 

3. The methodology for recorHing the interviews is appropriate. 

C. Clinical --Teaching Experiments 

1. The. phenomena under investigation are clearly identified. 

2. Plans for .the observation are detailed and related to the key 
elements of the study. 

D. Organizational Studies \ 

1. The organizational pattern is clearly defined. 

2. The commitment of the institutions involved is favorable. 

3. The researcher gives evidence of commitment to s^tudy the., 
effects of the alternative organizational patten in an eval- 
uative manner. 



EKLC 



SOME REASONS FOR REJECTION 



Class I: .The Problem 



U The problem is of insufficient Importance or is unlikely to produce any new 
or useful irifo'rmatibn* 

2. The proposed research is based on a hypothesis that rests on insufficient 
evidenc^V is doubtful, or is unsound, 

3. The problem is more complex than the investigator appears to realize. 
Class II: The Approaich . J— ■ - 

1. The proposal tests, methods', or scientific procedures are unsuited to the 
stated objectives, 

2. The description of the approach is too nebulous, diffuse, and lacking in> 
clarity tb permit adequate evaluation, 

3. The overalj. desi^ of the study has not been carefully thought out. 
Class III: The Personnel , 

1. 1 The investigator does not have adequate experience or training, or both, 
' for this research. - 

2. \The investigator appears to be unfamiliar with pertinent literature or 

methods, or both. ^ ^ 

3. The investigator's' previously published work in this field does not in- 
spire confidence. 
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